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Abstract. Digital image analysis has made a big advance in many areas 
of enterprise applications including medicine, industry, and entertain¬ 
ment by assisting the extraction of semantic information from digital 
images. However, its large computational complexity has been a trou¬ 
ble to most real-time developments. While image analysis in general has 
been studied for a log period in computer science community, the use of 
multithreading strategy as the most efficient improving computational 
capacity technique has been limited so far. In this survey an attempt is 
made to explain the current knowledge and so far progresses in incorpo¬ 
rating image analysis with multithreading approaches. The present work 
also provides insights and tendencies for the possible future enhancement 
of multithreading image analysis. 
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1 Introduction 

Image analysis as the intersection of digital signal processing, mathematical mod¬ 
els, and machine perception has made a big advance in variety of scientific and 
commercial applications consisting biomedicine, medicine, and industry by as¬ 
sisting the extraction of semantic information from digital images. The task of 
image analysis broadly lies from low level image processing such as image sharp¬ 
ening and contrast enhancement, to medium and perhaps high level processing 
including image segmentation, image registration, object tracking, and image 
watermarking. A challenge in image analysis applications is to tackle the large 
computational complexity of almost every image processing task to make such a 
real-time application. In the other side, the multithreading technique has been a 
very longstanding approach to employ instruction level parallelism which allows 
having several threads within the context of one single process and it definitely 
improves the computational capacity by concurrent execution of threads. Over 
the past few years, using multithreading strategies has found significant interest 
from the variety of scientific researches. This is obviously evident from Figure 1 
that shows the journal and conference papers related to the rubric which have 
been published in Elsevier from 2012 to 2014. Using multithreading techniques 
in the field of digital image analysis can be fulfilled the following objectives: 

• To facilitate the production of real-time image analysis applications. 

• To provide a capability for improving the computational aspects of digital 
image analysis. 



• To create scalable image analysis applications which can expand and work 
across multiple clusters. 

• To make distributed infrastructures for large scale digital image analysis. 

While digital image analysis algorithms and its applications have been stud¬ 
ied for a long period, the use of multithreading techniques in image processing 
has been limited so far. In this work, a survey is performed to review the cur¬ 
rent knowledge and so far progresses in incorporating digital image analysis with 
multithreading approaches. With the present paper, I also draw some possible 
enhancements for multithreading image analysis. 


Fig. 1 . Number of Elsevier publications on multithreading over the last three 
years. Results obtained by submitting query multithreading from Elsevier website at 
http: / / www.sciencedirect.com 
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The rest of this survey is arranged as follows. In Section 2, a brief introduction 
for both digital image analysis and multithreading approach is presented. The 
recent works and advances in the field of multithreading image analysis are 
reviewed in Section 3. I discuss and conclude the work in Section 4. 


2 An Introduction to Digital Image Analysis and 
Multithreading Approach 

While image analysis and its applications have been around for almost 50 years 
now, multithreading techniques dates back to about 24 years ago. In this section, 
a brief introduction on these rubrics is presented. 






2.1 Digital Image Analysis 


Today, we can see digital images everywhere form biomedical as well as as¬ 
tronomical domain to artistic applications. Digital image analysis enables the 
multimedia technology revolution we are experiencing these days. Some impor¬ 
tant examples of image processing include image sampling and quantization, 
image filtering and correlation, coloring, image segmentation, morphological im¬ 
age processing, noise reduction and restoration, feature extraction and object 
recognition tasks. All image analysis tasks are divided into three different cate¬ 
gories: 1) Low-level, 2) Medium-level, and 3) High-level jl] and [2J. In low-level 
image analysis techniques, we consider a digital image as an input and produce 
a digital image as output. It means that the input and output of this level are 
both digital images. Some examples include noise reduction and contrast en¬ 
hancement. Using medium-level image analysis, we get an image as an input 
and provide/extract some information form that. The output of this level is not 
an image. Image segmentation and object detection such as face detection are 
some examples. The most difficult part of the image analysis tasks is high-level 
one in which the input is an image but the output will be knowledge! For in¬ 
stance, an input could be a portrait image from a persons face, so the output 
could be whether the person is happy or sad. 

This is a very introductory level of digital image analysis. Readers interested 
in image analysis algorithms and its applications are referred to [3] and [1] for 
image registration, 0,0,13,0, and 0 for image segmentation, Dm, mi, and 
[12] for image forgery detection and image encryption, jT3], [14], [15] . [15] , and 
m for 3D surface reconstruction. Further information can be found in [T] and 
0 - 

2.2 Multithreading Approach 

A Thread can define as a path of execution through a program. Single threaded 
application has only one path of execution, while multi-threaded application has 
two or more path of execution. In such traditional processes, there is only a 
unique thread of control and a single Program Counter in every process. These 
processes can perform only one task at a time, and should finish each task 
before they can start another in the sequence. Using multithreading techniques, 
the system can support for multiple threads of control for a process at a time. 
Multithreading offers several advantages as follows m- 

• Better utilization for employing system resources. 

• Improved performance and concurrency. 

• Simultaneous access to multiple applications. 

• Task Parallelizations. 

Readers interested in multithreading techniques and their implementation 
can refer to [19] and [20] for more information. 


3 Literature Review 


The following literature review aims to show the current knowledge and so far 
progress in incorporating multithreading strategies and digital image analysis. 

In 1998, Yu et al. i2T| developed an image convolution algorithm with tradi¬ 
tional parallel methods. Their algorithm dramatically reduces computation cost. 
They discussed two parallel algorithms for performing image convolution, and 
concluded that using parallel techniques will speed up the image convolution 
task. However, they mentioned that selecting an algorithm for all application 
parameters is quite hard. 

In 2003, Penha et al. [22j performed a comparative study on multithread¬ 
ing image analysis based on shared-variables programming approach. They em¬ 
ployed explicit compiler directives from multi-thread support libraries. Their 
comparison between the implementations has done by considering two kinds of 
well-known operating systems: Windows and Linux. They have examined both 
general performance and programmability. The image convolution implementa¬ 
tions experiments showed significant performance improvement over sequential 
ones both in Windows and Linux. The programmability analysis showed that 
it is simpler for the programmer to develop p-thread based applications rather 
than another types of thread such as win threads. In general, they showed that 
using multithreading implementation will improve the general performance, but 
the implementation itself could not be convenient and easy for developers. 

In 2009, Lin et al. [25] carried out a multithreading strategy as parallel 
method to perform the PDE-baserl image registration. They implemented de¬ 
formable image registration and examine it on a dual core personal computer. For 
implantation, they used OpenMP as an API which can support multi-processing 
programming in CH—(-. Their experiments demonstrated that the method was 
able to produce the large size parallel image registration, reduce the computa¬ 
tional complexity, and save nearly a half computing time, however the imple¬ 
mentation part was not easy enough. 

In 2010, GG Slabaugh et al. [23] presented the entire pipeline of using 
OpenMP for doing image processing tasks such as image morphology, image fil¬ 
tering, and normalization. They summarized the general capabilities of OpenMP 
and showed that Signal and image processing programmers can benefit dramat¬ 
ically from multithreading techniques provided through OpenMP, by modifying 
a single-threaded code to operate parallelism. In 2013, Kika et al. [25] used Java 
programming to deploy digital image analysis tasks in single-core and multi-core 
CPU. They mentioned that the Java programming language is very appropri¬ 
ate to build and develop image analysis applications due to its features and the 
free and open source packages that it offers for this purpose. Their experimen¬ 
tal results showed that such a multithreading method will definitely improve 
the performance of image analysis algorithms either in single-core or multi-core 
CPU platforms, however the improvements are different. In single-core, the best 
results is achieved by the combination of small image size and less complex 
algorithm, while in multi-core CPU the combination of small image size and 
more complex algorithm improves the performance. They also concluded that 


the multithreading programming can improve the performance on multi-core 
CPU whenever complex image processing algorithms is applied. 

In 2015, Smistad et al. [35] developed an open-source efficient medical image 
analysis and visualization framework namely FAST (FrAmework for heteroge¬ 
neous medical image conrpuTing and visualization) using multithreading tech¬ 
niques. The code examples along with the evaluations have demonstrated that 
the framework is easy to use and performs better than existing frameworks, such 
as ITK and VTK. 

4 Discussion, Conclusion, and Possible Extension 

In this work, a survey is done to review the recent works in multithreading image 
analysis. After a brief introduction to digital image analysis and multithreading 
areas, five recent works multithreading image processing are reviewed. In almost 
every work, we can see that using multithreading strategies will improve the 
general performance of digital image analysis tasks such as image convolution, 
image filtering, and morphology either in single-core or multi-core CPU. The 
implementation multithreading techniques from scratch or using pre built open 
source library is still remain difficult. In general, multithreading approaches will 
improve the performance and time efficiency of the image analysis tasks and 
allows resource utilization. Difficulties in implementation, debugging, and man¬ 
aging concurrency are among some multithreading image analysis disadvantages. 
Multithreading image analysis using Big Data infrastructures would systemati¬ 
cally provide better performance and reliability to process Big Data images, such 
as very high resolution satellite images. Employing SaaS (Software as a Service) 
architecture would also provide application-to-application interaction for such 
systems. These could be considered as possible extensions for multithreading 
image analysis. 
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